• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    REMOTE PHOTOPLETISMOGRAPHY METHOD AND SYSTEM FORDRIVING REMOTE PHOTOPLETISMOGRAPHYA method of photoplethysmography that includesprocessing a signal (46; 56) based on at least onesignal (35; 50) from at least one sensor (5; 18 to 20; 26; 63)willing to capture light from a living patient to extractinformation about a characteristic of a biological phenomenonperiodical. At least one of the signs (35; 50) of at least onesensor (5; 18 to 20; 26; 63) is obtained by using at leasta light source (1; 11 to 13) and a filter (6; 17; 64)placed before at least one sensor (5; 18 to 20; 26; 63)tuned to a peak in a water absorption spectrum.
    公开号:BR112012007924A2
    申请号:R112012007924-7
    申请日:2010-10-04
    公开日:2020-08-18
    发明作者:Vincent Jeanne；Giovanni Cennini；Ihor Olehovych Kirenko
    申请人:Koninklijke Philips Electronics N. V；
    IPC主号:
    专利说明:

    there REMOTE PHOTOPLETISMOGRAPHY METHOD AND SYSTEM FOR DRIVING REMOTE PHOTOPLETISMOGRAPHY
    FIELD OF THE INVENTION The invention relates to a method of remote photoplethysmography, a system for conducting remote photoplethysmography and a computer program. and HISTORY OF THE INVENTION (7
    G Verkruysse, W. et al., "Remote plethysmographic imaging using ambient light", Optics Express M (26), December 22, 2008, pgs. 21434 to 21445 discloses a method in which photoplethysmographic signals were remotely measured using the use of ambient light and a common digital camera in the video mode. heart rate and respiratory rate could be quantified up to several harmonics. Although the green channel 15 had the strongest photoplethysmographic signal, corresponding to a peak of absorption by (oxyhemoglobin, the red and blue channels also contained photoplethysmographic information. A problem with the known method is that the green channel may be subject to noise that makes it difficult to carry the photoplethysmographic signal of interest 20. This is true even for a greater extent of other channels, which have only a weak '2 corrt correlation c) biometric signal.
    SUMMARY OF THE INVENTION jb '25 It is desirable to provide a method and system of the types mentioned above that increase the probability of being able to carry a relatively clear biometric signal even when there is noise in the green channel. This objective is achieved by the method in accordance with the invention, which includes: processing a signal based on at least one signal from at least one sensor arranged to capture light from a living patient to extract information about a
    2/20 6 · 1
    SJ characteristic of a periodic biological phenomenon, I understand that at least one of the signals from at least one sensor is obtained by using at least one light source and a filter placed before at least one sensor tuned to a 5 peak in a spectrum. water absorption. With this, c) method makes use of an ile sensitive channel.
    Variations in the reflected and / or transmitted light as a function of the pulsating blood plasma flow. The signal on that channel can be used additionally or alternatively to a channel sensitive to 10 variations in the amount of oxyhemoglobin in the illuminated area. Since a different frequency of light is used, a stronger signal is more likely to be obtained in circumstances where there is noise on a green channel. In one embodiment, the peak is in an interval that 15 corresponds to an interval of wavelengths of electromagnetic radiation in the air of above 750 nm. This reaction is suitable for use in situations where it is undesirable to have visible light. Examples include public spaces, military screening, night monitoring and 20 neonatal incubators. In a variant of this realization, the peak is in an interval that corresponds to an interval of 4 wave lengths less than 1100 nm. This realization has the effect that it is possible j "25 use photosensors (including beams of photodiodes) implemented in silicon technology. These sensors generally show a peak in their sensitivity around 800 nm or 900 nm. At 1000 nm, the sensitivity is slightly lower, but still high enough to detect photons in this spectral range, where there are also favorable peaks in the water absorption spectrum, specifically at 970 nm There are several cheap and available silicon sensors in the market, for example, CMOS and CCD beams.
    An embodiment of the method includes directing the polarized light to the living patient and capturing the light from the living patient through a polarization-dependent filter. This realization has the effect of eliminating ambient light, specifically including light with periodic components as well. "n In one embodiment, the signal obtained by using at least one light source and a filter placed before at least one sensor tuned to a peak in the water absorption spectrum is obtained from a first sensor and a second signal it is obtained from a second sensor, arranged to capture light from the living patient over a different wavelength range than the first sensor.The signal from the first sensor, although it includes a strong component representing the pulsating blood flow, can also include artifacts due the movement of the living patient and / or changes in lighting.The second signal may represent the light captured in a wavelength range that is not specifically sensitive to 20 changes in blood flow, but which includes the same artifacts due to the movement of the live patient and / or changes in lighting. With this, the second signal can be used to correct the first signal by removing components that do not represent general biological phenomena mind '* 25 journals. A variant of this embodiment includes the use of a beam splitter arrangement to divide the light of the living patient into a beam directed towards the first sensor and a beam directed towards the second sensor.
    30 This makes the correction made with the use of the second sensor signal more precise, since both signals include components that represent changes in the lighting or movement of the same surface area of the living patient. The division can be in the wavelength domain or it can be a polarization. Another variant includes subtracting a signal at least based only on the second signal from the first and 5 second signals from a signal at least based only on the second signal from the first and second signals. r This variant can be implemented with the use of relatively simple signal processing techniques. No complicated signal analysis is necessary. Subtraction 10 can be conducted specifically in the same time domain. The signals used in the subtraction operation can be at least based on the signals from the first and second sensors that they correspond to or that they can be obtained by applying a gain less than or greater than one, depending on the implementation. Another variant includes, before the use of the sensors to capture the light of the living patient, with the use of the sensors to capture light from a calibration surface and the adjustment of the parameters that affect at least one light capture and at least one signal supply. based on the signals from the sensors, in order to adjust at least one amplitude or one phase of the respective signals based on at least the signals of the - first and second sensors reciprocally. One effect is qi.'e the signs of the first and second
    W 25 sensors, or signals based on these respective signals obtained by simple multiplication, for example, can be directly subtracted from each other, specifically also in the time domain, when the method is applied to the living patient.
    In accordance with a further aspect of the invention, a system is provided for conducting remote photoplethysmography, including: at least one sensor to capture light from a
    5/20 patient alive; a signal processing system arranged to process a signal based on at least one signal from at least one sensor to extract information about a characteristic of a periodic biological phenomenon; and at least one light source and a filter placed 3ui before at least one of the sensors tuned to a peak in k is a water absorption spectrum. In one embodiment, the system is arranged to conduct a method according to the invention.
    BRIEF DESCRIPTION OF THE DRAWINGS The invention will be explained in more detail with reference to the attached drawings, in which: Fig. 1 is a schematic diagram of a first system for remote photoplethysmography; Fig. 2 is a schematic diagram of a second system for remote photoplethysmography; and Fig. 3 is a schematic diagram of a third system for remote photoplethysmography; 20 Fig. 4 is a flowchart that illustrates the steps in a first method to obtain an analysis signal to determine a characteristic of a biological - periodic phenomenon; Fig. 5 is a flow chart illustrating the steps in a second method for obtaining an analysis signal to determine a characteristic of a periodic biological phenomenon; and Fig. 6 is a schematic diagram of a fourth system for remote photoplethysmography.
    30 DETAILED DESCRIPTION OF THE ACHIEVEMENTS Various accomplishments of a system for remote photoplethysmography will be explained here. Photoplethysmography is a method to characterize certain periodic physiological phenomena using variations in skin reflectance. Human skin can be modeled as an object with at least two layers, one being the epidermis (a thin surface layer) and the other the dermis (a thicker layer 5 below the epidermis). Approximately 5% of a ray of light that enters is reflected in the epidermis, which occurs in all wavelengths and skin colors. The remaining light is diffused and absorbed in the two skin layers in a phenomenon known as body reflectance (described 10 in the Jjicromatic Reflection Model). The epidermis behaves like an optical filter, mainly absorbing light. In the dermis, the light is diffused and absorbed. Absorption is dependent on blood composition, so that absorption is sensitive to variations in blood flow. The optical properties of the dermis 15 are generally the same for all races of the human species. The dermis contains a dense network of blood vessels, about 10% of an adult's entire network of blood vessels. These vessels contract according to the blood flow in the body. They consequently alter the 20 structures of the dermis, which influence the reflectance of the skin layers. Consequently, heart rate can
    N be determined from variations in skin reflectance. A first photoplethysmography system (Fig. 1)
    G 25 comprises a light source 1 and an optical system for focusing the light from the light source onto an exposed skin area in a living patient, for example, a human. The optical system in the illustrated embodiment comprises a beam splitter 2 and a first lens 3.
    The reflected light is collected by the first lens 3, reflected in the beam divider 2 and focused by a second lens 4 for a photosensor 5. In other embodiments, the optical system comprises other elements, including one or more elements such as lenses, concentrators, beam splitters, prisms and others.
    In the illustrated embodiment, lu7 passes through filter 6. Filter 6 is at least wavelength dependent, 5 being arranged to pass a narrow band of wavelengths centralized at a wavelength - 0 corresponding to a peak in the spectrum. water absorption. THE . The passband has a width dependent on the position of the peak in the water absorption spectrum. Generally, the width is 10 so that half the maximum total width of the absorption peak is contained within the passband. The width can therefore vary from 100 nm to 1 µm. Peaks in the water absorption spectrum occur at frequencies corresponding to wavelengths of 514, 606, 660 and 739 nm within the visible spectrum. Other peaks occur at 836 and 970 nm outside the visible part of the spectrum. The latter values are used in settings where ambient light levels are low and light source 1 must not emit much visible light. In fact, in certain embodiments, light source 1 is not used, 20 the signal provided by photosensor 5 is entirely due to reflected ambient electromagnetic radiation. In embodiments in which light source 1 is used, - filter 6 and light source 1 may be polarization dependent. In this way, the signal from photosensor 5 can be kept generally free of variations as a function of changing ambient light levels. In the illustrated embodiment, the signal from photosensor 5 is obtained by a data processing device 7, which can be a computing device programmed for 30 general purposes or an application specific device. The data processing device 7 also provides control signals to a controller 8 and a driver 9 to connect the light source 1. In one embodiment, these two m, -
    * Components 8, 9 are integrated into a single device with the data processing device 7. To increase the signal-to-noise ratio of the photosensor signal 5, heterodyne detection can be employed. The light emitted by light source 1 is modulated to a specific>.
    + frequency v. Photosensor 5 will therefore provide a signal that ~. is at the same frequency and light at other frequencies. The light ' on the other frequencies it can be rejected. In one embodiment, the light source 1 is arranged to emit 10 light across a wide spectrum. In another embodiment, light source 1 is tuned to a frequency that corresponds to a peak in the water absorption spectrum. In particular, this frequency is generally the same to which the wavelength-dependent filter 6 is tuned. If frequency 15 corresponds to a wavelength in the air of 836 nm or 970 nm, then no visible electromagnetic radiation is emitted. The data processing device 7 conducts operations such as filtering and analysis. In particular, the data processing device 7 is arranged to determine the frequency at which the spectrum of the filtered signal or signal has a local maximum, at least in a predetermined interval corresponding to the interval in which an associated signal is expected. to a periodic biological phenomenon is present. With that, the frequency ±
    W 25 heart rate or respiratory rate of the individual from which the captured light emanates. The information representing the determined value is provided on an output device 10. It is also possible to use light at a frequency that corresponds to a peak in the water absorption spectrum in addition to the light at a different frequency. This is illustrated in Fig. 2, in which a system similar to the one in Fig. 1 is shown, but with three light sources ll to 13. In the illustrated embodiment, an optical system is also used which comprises a
    .
    See beam splitter 14, a first lens 15 to focus the light on the exposed skin of a living being and collect the light that - ..
    reflects back, and a second lens 16 and dependent filter "" '-C' "'mH of polarization 17.
    5 Each of these three photosensors 18 to 20 are sensitive to electromagnetic radiation in an interval n a "different from the spectrum, with at least one of these intervals
    7. limited. The three intervals can overlap. .. One of the three Eosensors 18 to 20 is tuned to 10 a peak in the water absorption spectrum. In one example, another of the three photosensors 18 to 20 is tuned to a range of wavelengths within a range of 500 nm to 600 nm, which corresponds to green light. This sensor is therefore sensitive to variations in the amount of oxyhemoglobin 15 in the skin. The third of the three sensors 18 to 20 can be tuned to a range of wavelengths that is not particularly sensitive to variations in skin reflectance.
    In fact, the third of photosensors 18 to 20 can simply detect changes in light intensity across the entire spectrum. The signals from photosensors 18 to 20 are provided with a data processing device 21 that processes them to provide a signal that can be analyzed to determine a characteristic of a component that corresponds to a periodic biological phenomenon, for example, a heart rate value. To that end, the correlations between the signal from the sensor tuned to the green light and the signal from the sensor tuned to a peak in the water absorption spectrum can be determined, considering that the signals can be decorrelated from the signal of the third sensor. This produces a single signal that has a relatively clean and strong component due to changes in skin reflectance. The signal analysis is conducted by the
    '10/20 X. 0 m W
    Y data processing 21 to determine a characteristic of the signal, for example, the frequency (step 47). The information representing the characteristic is provided in>, an output device 22. "~, 5 For improvement of the signal to noise ratio, the illustrated embodiment uses tuned light sources 11 to 13
    U "arranged to emit light in the intervals of the spectrum of z corresponding electromagnetic radiation to which photosensors 18 to 20 are tuned. A driver 23 and 10 controller 24 are provided to connect light sources ll to
    13. Controller 24 is connected to data processing device 21. As in Fig. 2, heterodyne detection can be used to further improve the signal-to-noise ratio 15. With reference to Fig. 3, a system for remote photoplethysmography using images comprises a data processing system 25 and a video camera
    26. The video camera 26 is arranged to provide a sequence 20 of images to an interface 27 of the data processing system 25. The data processing system 25 includes a data processing device 28 and main memory and 29 to execute instructions included with soEtware stored on a mass storage device 30. The
    Data processing 25 also comprises an interface to an output device 32 such as a monitor.
    A first realization of a £ otoµletisrnographic method conducted by the data processing system 25 is illustrated in Fig. 4.
    30 In this realization, an initialization step 33 is completed first, to determine the appropriate settings for the video camera 26. To do this, the data processing system 25 causes at least one between rates
    .
    frame rate, exposure time, pixel clock (the setting that determines the rate at which pixel values are needed) and the video channel 26 camera channel gain to be varied while the digital 5 image sequence is captured . The average (spatial) brightness of at least part of each image in the sequence is determined and the magnitude
    P of periodic fluctuations in the medium brightness is determined for. each new setting value. Those configurations in which the magnitude in at least one range of the spectrum, in particular a range of up to 100 Hz, the smallest are selected for subsequent use in the method. Instead of determining the average spatial brightness of at least part of the image, the brightness fluctuations of an individual pixel can be determined. The effect of choosing the settings of the video camera 26 is that periodic backlight fluctuations are absent as much as possible from the image sequences to which the rest of the method is applied. In a next step 34, the sequence 35 of images is obtained from the video camera 26.
    In one embodiment, the video camera 26 is provided with a single filter tuned to a wavelength corresponding to a peak in the water absorption spectrum. In - specific, as in the achievements discussed above, this can be a wavelength corresponding to a frequency in the '25 visible part of the spectrum, for example, 514, 606, 660 or 739 nm. In another embodiment, the frequency may be just outside the visible range of the spectrum, for example, 836 nm or 970 nm, which again allows the use of common silicon-based photosensor beams that are sensitive in that part of the spectrum. In an alternative embodiment, the video camera 26 is provided with a plurality of filters, so that each image in the sequence 35 corresponds to a plurality of
    »=: 'Image frames, each one comprising a bundle of pixel values representing the intensity of light in a range · different from the spectrum of electromagnetic radiation. At least one sequence of image frames corresponds to a limited interval 5 centered on a frequency that corresponds to a peak in the water absorption spectrum. i; · Subsequently, images 35 are processed. G (step 36) to remove non-periodic background signals. For this, a correction signal is formed that corresponds to a medium brightness variant of part time or all images
    35. In the illustrated embodiment, the pixel data of the images 35 is then de-correlated with the correction signal. The algorithms for canceling nonlinear cross correlations are known per se. Other image processing may occur at this stage 36, for example, to compensate for camera movement. In the next two steps 37, 38, an image segmentation method is performed on at least one image in the image sequence 35. In particular, an algorithm is conducted to detect a part of the body, usually the face of a human being, in these steps 37, 38. A suitable algorithm is described in Viola, P. and jones, Mj, "Robust real-, t time object detection ", Proc. Of IEEE Workshop on statistical and computational theories of vision, July 13, 2001.% 25 Other suitable algorithms based on the recognition of segments with unique determinations and / or colors (skin color, for example) are known and can be used additionally or alternatively to this algorithm described in the literature. At least a distinct segment 39 determined to correspond to a body part of the desired type is tracked (step 40) through the sequence 35 of images. This means that segment 39 is placed, that is, its location is determined by comparing the images in the sequence 35 to quantify the movement of the body part in the images 35. An appropriate tracking algorithm, for example, by De Haan, is known et al., "True-motion estimation with 3-D recursive search block inatching", TEEE Transactions on circuits and 5 systems for video technology, .3, (5), October 1993, p. 368-379.
    V Subsequently, for each segment 39 selected. and tracked, the measurement zone 41 on the image segment 39 is selected (step 42). This step 42 involves a spatial analysis of the pixel data of a pIurality of image parts - each part being one or more image points in size - to determine a set of contiguous parts having similar characteristics. These parts are selected to form the measurement zone 41. The position of the measurement zone 41 is determined in relation to the tracked segment 39 in which it is included, so that it is tracked in the same way. A next step 43 involves the generation of a brightness signal 44 of which each value is a combination of pixel values 20 of the measurement zone 41 in a specific image in the image sequence 35. Where the images comprise image frames that correspond to different intervals in the spectrum of electrornagnetic radiation, this step 43 may include a plurality of '25 steps (not shown in detail), in which a separate signal is formed for each sequence of image frames.
    These separate signals are then processed to provide a single signal 44. Specifically, where a sequence of image frames corresponds to a frequency range that 30 corresponds to a peak in the water absorption spectrum and another sequence corresponds to green light, only common signal components can be maintained. A sequence that corresponds to a general level of intensity or a sub-interval insensitive to variations in function of the pulsating blood flow can be used to remove the noise.
    Then (step 45), the brightness signal 44 is centered at its average value, generating a final signal 46 5 representing at least variations in a value based on a pIurality of pixel values for each image in the sequence
    B of images 35. In alternative embodiments, a different technique is used to extract variations in the order of 1% of the dynamic range of the brightness signal 44, for example, a filtering operation involving a differentiation step. Finally (step 47), a characteristic of the periodic biological phenomenon being monitored is extracted. It could be the heart rate of an individual being monitored, for example. Using, for example, a Fast Fourier Transformation 15, a local maximum in the spectrum of signal 46 can be determined. An alternative method to that of Fig. 4 is illustrated in Fig. 5. This realization also allows the generation of maps phase, for example.
    20 The method in Fig. 5 also starts with an initialization step 48 to determine appropriate video camera settings 26. The data processing system 25 makes at least one between frame rate, exposure time, pixel clock (the setting that determines the "25 rate at which pixel values are needed) and the camera channel gain of the video camera 26 to be varied while the digital image sequence is captured. The average (spatial) brightness of no minimum part of each image in the sequence is determined and the magnitude of periodic fluctuations in the average brightness is determined for each new value of the settings, these configurations in which the magnitude in at least one range of the spectrum, in particular a range of up to 100 Hz , the smallest ones are selected for subsequent use in the method, instead of determining the average spatial brightness of at least part of the image, the brightness fluctuations of an individual pixel can be determined.
    Then (step 49), a sequence of 5 images 50 is obtained. As in the embodiment of Fig. 4, this sequence 50 can be composed of a plurality of image frame sequences, each corresponding to a different part of the - spectrum of electromagnetic radiation (ie, a different color channel if only a visible spectrum is used).
    10 Images 50 are processed to remove non-periodic background signals with the use of a correction signal that corresponds to an average brightness variant of part time or all settings 50 (step 51). This step is similar to the corresponding step 36 in Fig. 4.
    15 Next (step 52), a grid is placed on images 50, which divides each image into a plurality of measurement zones, or at least potential measurement zones. Each measurement zone includes a plurality of pixel values.
    The signals 53a-n are extracted (step 54) for at least one, but more generally a plurality of measurement zones as defined by the grid. This step 54 involves combining pixel values from a measurement zone into a single value, so that each value of signal 53 is based on "25 pixel values from just one of the 50 images. The result is a set of signals 53a-n of time variation representing the brightness of an associated measurement zone In one embodiment, the pixel values are combined by averaging. In another embodiment, pixel values 30 are combined by calculating the average value. combination removes random noise, leading to a signal with a stronger component that corresponds to a periodic biological phenomenon.
    Where the image sequence 50 is composed of a plurality of image frame sequences, each associated with a different range of the electromagnetic radiation spectrum, the pixel values of the corresponding measurement zones in each of the image frames that form 5 an image are combined. The combination serves to remove background signals or enhance components that correspond to biological signals. Thus, where the image frames - comprise pixel values that correspond to intensity values in a spectrum interval centered on a peak in the water absorption spectrum and pixel values that correspond to intensity values in a spectrum interval within the range between 500 nm and 600 nm, the combination step 54 may include a cross correlation step.
    Then (step 55), signals 53a-n are centered in their averages, generating another set of signals 56a-n representing at least variations in a value based on the pixel values of the respective associated measurement zones. Instead of centralizing the signals 53a-n in their averages, another suitable operation to extract variations in the order of 1% of the dynamic range of the signals 53a-n can be applied, for example, differentiation or a similar filtering operation. Finally (step 57), a characteristic of at least - a component of at least one of the final signals 56a-n is "25 determined. For example, the frequency of a local maximum in the spectrum of signals 56a-n can be determined, to establish a person's heart rate value represented in the sequence of 50 images. In another embodiment, in which all measurement zones are used, a 30-phase map is created. In another embodiment, the grouping of signals 56a is used -n or values obtained from the final 56a-n signals to establish a consensus value that characterizes a biological phenomenon.
    A completely different realization of a system for photoplethysmography is illustrated in Fig. 6. This system obtains two signals, one of which is used to remove movement and lighting artifacts from each other.
    5 In the illustrated embodiment, the system includes a light source 58. The light source 58 can emit a spectrum with two peaks, it can emit a continuous spectrum or it can emit light. with both characteristics. In an alternative embodiment, light source 58 is not used. Instead, ambient light 10 (white). The system of Fig. 6 also includes an optical system comprising a first beam splitter 59, a first lens 60 to focus the light from the light source 58 onto the exposed skin of a living being and collect the light that reflects back, 15 and a second lens 61. The light collected by the second lens 61 is passed through a second beam splitter 62. The second beam splitter 62 can be a polarization-dependent or wavelength-dependent beam splitter. It divides light 20 comprising at least two wavelengths in separate beams. A first beam is directed to a first - sensor 63 by means of a first filter 64. The first filter 64 is tuned to a peak in the absorption spectrum of "25 water. In one embodiment, the peak is in an interval that corresponds to a range of wavelengths above 750 nm. In addition, the range can end below 1100 nm. A second beam is directed through a mirror 65 and a second filter 66 on a second sensor 67. The second filter 66 is willing to pass light in a different wavelength range than the first filter 64, so that the second sensor 67 is willing to capture light from the living patient in a different wavelength range than the first sensor 63 .. It is noted that the different wavelength range can overlap the wavelength that the first filter 64 is tuned in. In particular, the second filter 66 can be omitted, so that the second sensor 67 * provides a representative signal. levels of ambient light. In general, however, the length range of. different wave will be separated into parts from the 10-pass band of the first filter 64. The signals from sensors 63, 67 are provided for a signal subtraction device 68 (for example, an operational amplifier), so that the second signal sensor 67 is subtracted from the signal of the first sensor 63.
    15 The result is provided for a data processing device 71 that processes, for example, analyzes, the difference signal to provide an output characteristic of a component that corresponds to a periodic biological phenomenon, for example, a frequency value 20 cardiac. The analysis of the signal by the data processing device 21 may include determining a characteristic of the signal, for example, the frequency. The "information representing the characteristic is provided on an output device 72. b 25 For further improvement of the signal-to-noise ratio, heterodyne detection can be used, at the end of which a driver 69 and a controller 70 are provided to connect the light source 58. In order to ensure that the signal subtracted from the signal of the first sensor 63 does in fact remove the components in function of the movement of the living patient and / or changes in the illumination of the environment of the living patient, a calibration step is conducted before the use of the system of Fig. 6 in a live patient In the calibration step, a calibration surface is provided, on which the light from the light source 58 is focused. This calibration surface is, in one embodiment, a white diffuser 5 with known diffusing properties (such as wavelength, angle to an optical axis of the first lens 60 and polarization). Then the sensitivity and gain of the two sensors 63,67 are adjusted so that the signals provided s to the subtraction device 68 are 10 identical in phase and amplitude. In one embodiment, this calibration phase is conducted by different combinations of angles, wavelengths and polarizations. Calibration does not need to be conducted in the field, but can be conducted when the system in Fig. 6 is manufactured. In one embodiment, the data processing device 71 is used to remember the correct settings.
    It should be noted that the above-mentioned embodiments illustrate the invention, do not limit it, and that it is evident to those skilled in the art that it is possible to design many alternative embodiments without escaping the scope of the appended claims. In claims, any reference sign placed in parentheses should not be - interpreted as limiting the claim. The word "understand" does not exclude the presence of elements or steps' 25 other than those listed in a claim. The word "one" or "urn" that precedes an element does not exclude the presence of a plurality of such elements. The mere fact that certain measures are recited in mutually different claims does not indicate that a combination of these measures cannot be used to advantage. In a variant of the embodiments of Figs. 1 to 3, the data processing device 7, 21 or the data processing system 25 provides an output signal that has a frequency that corresponds to the periodic biological phenomenon of interest, which can be used to attach another device (not (shown), as an imaging device.
    5 In a variant of the embodiment of Fig. 3, the data processing system 25 includes an interface for one or more light sources. One of the light sources can be. tuned to a peak in the water absorption spectrum, specifically one of the wavelength values in the almost infrared part 10 of the electromagnetic spectrum given above.
    权利要求:
    Claims (10)
    [1]
    1. REMOTE PHOTOPLETISMOGRAPHY METHOD, characterized by: q processing a signal (46; 56) based on the minimum 5 a signal (35; 50) from at least one sensor (5; 18 to 20; 26; 63) willing to capture light from a living patient to
    U extract information about a characteristic of a phenomenon. periodic biological, in which at least one of the signals (35; 50) of at least one sensor (5; 18 to 20; 26; 63) is obtained by using at least one light source (1; 11 to 13) and a filter (6; 17; 64) placed before at least one sensor (5; 18, 19, 20; 26; 63) tuned to a peak in a water absorption spectrum.
    [2]
    2. METHOD, according to claim 1, 15 characterized in that the peak is in a range that corresponds to a range of wavelengths of electromagnetic radiation in the air of above 750 nm.
    [3]
    METHOD, according to claim 2, characterized in that the peak is in a range that corresponds to a range of wavelengths less than 1100 nm.
    [4]
    4. METHOD, according to claim 1, - characterized by including the directing of polarized light to the living patient and capture of the light from the living patient "25 through a filter dependent on polarization (6; 17).
    [5]
    5, METHOD according to claim 1, characterized in that the signal obtained by using at least one light source and a filter placed before at least one sensor tuned to a peak in the water absorption spectrum 30 is obtained from a first sensor (63) and a second signal is obtained from a second sensor (67), arranged to capture light from the living patient in a different wavelength range than the first sensor (63).
    [6]
    6. METHOD, according to claim 5, characterized by including the use of a beam-splitting arrangement (62) to divide the light of the living patient into a beam directed towards the first sensor (63) and a beam 5 directed towards the second sensor (67).
    [7]
    METHOD, according to claim 5, characterized in that it includes the subtraction of a signal at least. based only on the second signal of the first and second signals of at least one signal based only on the second signal 10 of the first and second signals.
    [8]
    8. METHOD, according to claim 5, characterized by including, before the use of the sensors (63, 67) to capture the light of the living patient, with the use of the sensors (63, 67) to capture light from a calibration surface and the adjustment of the parameters that affect at least a light capture and a signal provision at least based on the signals from the sensors (63, 67), in order to adjust at least an amplitude or a phase of the respective signals based on the minimum in the signals of the first and second sensors (63, 67) reciprocally.
    [9]
    9. SYSTEM FOR CONDUCTING REMOTE PHOTOPLETISMOGRAPHY, characterized by including:
    W at least one sensor (5; 18 to 20; 26; 63) to capture light from a living patient; "25 a signal processing system (7; 21; 25; 71) arranged to process a signal (46; 56) based on at least one signal (35; 50) from at least one sensor (5; 18-20 ; 26; 63) to extract information about a characteristic of a periodic biological phenomenon; and at least one light source (1; 11 to 13) and a filter (6; 17; 64) placed before at least one of the sensors (5; 18-20; 26; 63) tuned to a peak in a water absorption spectrum.
    [10]
    A system according to claim 9, characterized in that it is arranged to conduct a method, as defined in any one of claims 1 to 8.
    «@ E g
    类似技术:
    公开号 | 公开日 | 专利标题
    BR112012007924A2|2020-08-18|remote photoplethysmography method and system for performing remote photoplethysmography
    US8805019B2|2014-08-12|Processing images of at least one living being
    US10568507B2|2020-02-25|Pupil ptychography methods and systems
    JP5856960B2|2016-02-10|Method and system for obtaining a first signal for analysis to characterize at least one periodic component of the first signal
    JP6268182B2|2018-01-24|Apparatus and method for extracting physiological information
    JP5029150B2|2012-09-19|Biological information acquisition apparatus and biological information acquisition method
    FR2785170A1|2000-05-05|Device to generate data and an image representative of the degree of tissue lesion associated with human skin burns that is rapid, non-invasive and objective
    JP6784403B2|2020-11-11|Heart rate variability estimation method, heart rate variability estimation program and heart rate variability estimation system
    US20160157736A1|2016-06-09|System and Methods for Assessment of Relative Fluid Flow Using Laser Speckle Imaging
    US9741113B2|2017-08-22|Image processing device, imaging device, image processing method, and computer-readable recording medium
    JP6613028B2|2019-11-27|Imaging device
    US10682081B2|2020-06-16|Acquiring and processing non-contact functional near-infrared spectroscopy data
    Cobos-Torres et al.2017|Simple measurement of pulse oximetry using a standard color camera
    JP2017029318A|2017-02-09|Method for processing image for stress-monitoring and program of the same
    Imaduddin et al.2015|A computationally efficient heart rate measurement system using video cameras
    Riha et al.2008|Searching for a new non-invasive method of blood circulation system diagnostics
    US10264960B2|2019-04-23|Information processing apparatus, operation method thereof, and computer program
    JP6535701B2|2019-06-26|Imaging device
    JP2018000587A|2018-01-11|Information acquisition device, imaging device and information acquisition method
    Chen et al.2021|Real-time oxygenation mapping from structured light imaging with deep learning
    WO2021099127A1|2021-05-27|Device, apparatus and method for imaging an object
    CN112784731A|2021-05-11|Method for detecting physiological indexes of driver and establishing model
    Lempe et al.2013|Software-assisted live visualization system for subjacent blood vessels in endonasal endoscopic approaches
    同族专利:
    公开号 | 公开日
    WO2011042851A1|2011-04-14|
    EP2485639B1|2019-08-14|
    US20120197137A1|2012-08-02|
    EP2485639A1|2012-08-15|
    JP6148009B2|2017-06-14|
    RU2550427C2|2015-05-10|
    RU2012118645A|2013-11-20|
    US10271746B2|2019-04-30|
    CN102647941A|2012-08-22|
    JP2013506525A|2013-02-28|
    CN102647941B|2015-11-25|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US4958638A|1988-06-30|1990-09-25|Georgia Tech Research Corporation|Non-contact vital signs monitor|
    RU2032376C1|1991-06-28|1995-04-10|Московский областной научно-исследовательский клинический институт|Method for determining status of biological tissue and photoplethysmograph for carrying out same|
    US5203328A|1991-07-17|1993-04-20|Georgia Tech Research Corporation|Apparatus and methods for quantitatively measuring molecular changes in the ocular lens|
    EP0527703B1|1991-08-12|1995-06-28|AVL Medical Instruments AG|Device for measuring at least one gaseous concentration level in particular the oxygen concentration level in blood|
    US5699797A|1992-10-05|1997-12-23|Dynamics Imaging, Inc.|Method of investigation of microcirculation functional dynamics of physiological liquids in skin and apparatus for its realization|
    AP931A|1995-10-23|2001-02-02|Cytometrics Inc|Method and apparatus for reflected imaging analysis.|
    US5995856A|1995-11-22|1999-11-30|Nellcor, Incorporated|Non-contact optical monitoring of physiological parameters|
    US7171251B2|2000-02-01|2007-01-30|Spo Medical Equipment Ltd.|Physiological stress detector device and system|
    JP2001526073A|1997-12-22|2001-12-18|ビー・ティー・ジー・インターナショナル・リミテッド|Artifact reduction in optical volume fluctuation recording|
    JP3547968B2|1998-01-19|2004-07-28|株式会社日本自動車部品総合研究所|Pulse waveform detector|
    US7904139B2|1999-08-26|2011-03-08|Non-Invasive Technology Inc.|Optical examination of biological tissue using non-contact irradiation and detection|
    WO2000044274A2|1999-01-29|2000-08-03|Pougatchev Vadim I|Personal physiological monitor|
    US6442411B1|1999-04-21|2002-08-27|Optix, Lp|Method for improving calibration of an instrument for non-invasively measuring constituents in arterial blood|
    US6915154B1|1999-09-24|2005-07-05|National Research Council Of Canada|Method and apparatus for performing intra-operative angiography|
    JP2005095193A|2000-04-05|2005-04-14|Matsushita Electric Ind Co Ltd|Biological information measuring method and measuring device|
    DE10051943B4|2000-10-19|2015-01-15|Fresenius Medical Care Deutschland Gmbh|Method and device for pulse wave transit time determination and extracorporeal blood treatment device with such a device|
    US8135448B2|2001-03-16|2012-03-13|Nellcor Puritan Bennett Llc|Systems and methods to assess one or more body fluid metrics|
    US6591122B2|2001-03-16|2003-07-08|Nellcor Puritan Bennett Incorporated|Device and method for monitoring body fluid and electrolyte disorders|
    US6909912B2|2002-06-20|2005-06-21|University Of Florida|Non-invasive perfusion monitor and system, specially configured oximeter probes, methods of using same, and covers for probes|
    US7738935B1|2002-07-09|2010-06-15|Pacesetter, Inc.|Methods and devices for reduction of motion-induced noise in pulse oximetry|
    GB0327100D0|2003-11-21|2003-12-24|King S College Hospital Nhs Tr|Blood flow monitoring equipment|
    US7190985B2|2004-02-25|2007-03-13|Nellcor Puritan Bennett Inc.|Oximeter ambient light cancellation|
    US7277741B2|2004-03-09|2007-10-02|Nellcor Puritan Bennett Incorporated|Pulse oximetry motion artifact rejection using near infrared absorption by water|
    AU2005286872B2|2004-09-21|2012-03-08|Digital Signal Corporation|System and method for remotely monitoring physiological functions|
    US7840246B1|2005-09-20|2010-11-23|Pacesetter, Inc.|Implantable self-calibrating optical sensors|
    GB0607270D0|2006-04-11|2006-05-17|Univ Nottingham|The pulsing blood supply|
    WO2007144880A2|2006-06-13|2007-12-21|Elfi-Tech Ltd.|System and method for measurement of biological parameters of a subject|
    US8360986B2|2006-06-30|2013-01-29|University Of Louisville Research Foundation, Inc.|Non-contact and passive measurement of arterial pulse through thermal IR imaging, and analysis of thermal IR imagery|
    US8189887B2|2006-10-02|2012-05-29|Johnson & Johnson Consumer Companies, Inc.|Imaging standard apparatus and method|
    US20100056887A1|2006-11-27|2010-03-04|Pioneer Corporation|Emission sensor device and bioinformation detecting method|
    US20080294012A1|2007-05-22|2008-11-27|Kurtz Andrew F|Monitoring physiological conditions|
    EP2249703B1|2008-01-25|2015-11-25|Novadaq Technologies Inc.|Method for evaluating blush in myocardial tissue|
    EP2087836B1|2008-02-07|2012-04-04|Pulsion Medical Systems AG|Apparatus and method for determining a physiological parameter|
    US20090247853A1|2008-03-31|2009-10-01|Nellcor Puritan Bennett Llc|Non-Invasive Total Hemoglobin Measurement by Spectral Optical Coherence Tomography|
    US20110251493A1|2010-03-22|2011-10-13|Massachusetts Institute Of Technology|Method and system for measurement of physiological parameters|US20100030040A1|2008-08-04|2010-02-04|Masimo Laboratories, Inc.|Multi-stream data collection system for noninvasive measurement of blood constituents|
    WO2013017976A1|2011-08-01|2013-02-07|Koninklijke Philips Electronics N.V.|Device and method for obtaining and processing measurement readings of a living being|
    GB201114406D0|2011-08-22|2011-10-05|Isis Innovation|Remote monitoring of vital signs|
    JP5773816B2|2011-09-12|2015-09-02|キヤノン株式会社|Imaging device|
    CN105380635A|2013-06-03|2016-03-09|飞比特公司|Heart rate data collection|
    JP2015532164A|2012-10-23|2015-11-09|コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ．|Device and method for obtaining vital sign information of organisms|
    US9955900B2|2012-10-31|2018-05-01|Quaerimus, Inc.|System and method for continuous monitoring of a human foot|
    US9901298B2|2012-11-01|2018-02-27|Quaerimus Medical Incorporated|System and method for prevention of diabetic foot ulcers using total internal reflection imaging|
    CN104755018B|2012-11-02|2017-05-24|皇家飞利浦有限公司|device and method for extracting physiological information|
    JP6270287B2|2012-11-23|2018-01-31|コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ．|Device and method for extracting physiological information|
    CN102973259A|2012-11-30|2013-03-20|刘庆国|Photoelectric heart rate measuring circuit|
    EP2762066A1|2013-02-05|2014-08-06|Koninklijke Philips N.V.|System and method for determining vital sign information of a subject|
    MX2015011368A|2013-03-06|2015-12-16|Koninkl Philips Nv|System and method for determining vital sign information.|
    US10238292B2|2013-03-15|2019-03-26|Hill-Rom Services, Inc.|Measuring multiple physiological parameters through blind signal processing of video parameters|
    US20140330132A1|2013-05-02|2014-11-06|Aza Raskin|Physiological characteristic detection based on reflected components of light|
    BR112016002546A2|2013-08-06|2017-08-01|Koninklijke Philips Nv|remote photoplethysmographic monitoring system and method for extracting physiological information indicative of at least one health symptom from remotely detected electromagnetic radiation, and computer program|
    WO2015030832A1|2013-08-31|2015-03-05|Pandata Research Llc|Integrated optoelectronic module for physiological measurements and methods of use of the module|
    JP6371837B2|2013-10-17|2018-08-08|コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ．|Devices and methods for obtaining vital signs of subjects|
    WO2015150096A1|2014-03-31|2015-10-08|Koninklijke Philips N.V.|Device, system and method for determining vital signs of a subject|
    US20150327800A1|2014-05-16|2015-11-19|Mediatek Inc.|Apparatus and method for obtaining vital sign of subject|
    WO2016003268A2|2014-06-30|2016-01-07|Scint B.V.|Method and device for measuring a health status and physiological parameters of an user at rest and under movement|
    TWI558375B|2014-09-18|2016-11-21|義明科技股份有限公司|Ppg signal processing device and method thereof|
    US9770213B2|2014-10-30|2017-09-26|Koninklijke Philips N.V.|Device, system and method for extracting physiological information|
    EP3218681A2|2014-11-13|2017-09-20|Nederlandse Organisatie voor toegepast- natuurwetenschappelijk onderzoek TNO|Spatially resolved gas detection|
    CN104622444B|2015-01-30|2017-03-22|中国科学院电子学研究所|Wrist monitoring system with multiple photoelectric sensor modules|
    DE102015104312A1|2015-03-23|2016-09-29|Osram Opto Semiconductors Gmbh|Sensor for detecting a biometric function|
    EP3087916A1|2015-04-28|2016-11-02|Nokia Technologies Oy|Physiological measurement sensor|
    US10448871B2|2015-07-02|2019-10-22|Masimo Corporation|Advanced pulse oximetry sensor|
    US10244987B2|2015-08-13|2019-04-02|Pixart Imaging Inc.|Physiological detection system with adjustable signal source and operating method thereof|
    US9717424B2|2015-10-19|2017-08-01|Garmin Switzerland Gmbh|System and method for generating a PPG signal|
    US10335045B2|2016-06-24|2019-07-02|Universita Degli Studi Di Trento|Self-adaptive matrix completion for heart rate estimation from face videos under realistic conditions|
    US11076771B2|2016-09-22|2021-08-03|Apple Inc.|Systems and methods for determining physiological signals using ambient light|
    CN106889980A|2017-01-13|2017-06-27|佳禾智能科技股份有限公司|Self adaptation switching heart rate detection method, device and wearable heartbeat detection device based on spectrogram|
    US10939833B2|2017-05-01|2021-03-09|Samsung Electronics Company, Ltd.|Determining artery location using camera-based sensing|
    EP3501380A1|2017-12-22|2019-06-26|Nokia Technologies Oy|Detector arrangement suited for optical sensors|
    法律状态:
    2020-09-08| B06F| Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]|
    2020-09-29| B25D| Requested change of name of applicant approved|Owner name: KONINKLIJKE PHILIPS N.V. (NL) |
    2020-10-06| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|
    2020-10-20| B25G| Requested change of headquarter approved|Owner name: KONINKLIJKE PHILIPS N.V. (NL) |
    2020-10-27| B08F| Application dismissed because of non-payment of annual fees [chapter 8.6 patent gazette]|Free format text: REFERENTE AS 9A E 10A ANUIDADES. |
    2021-01-19| B11B| Dismissal acc. art. 36, par 1 of ipl - no reply within 90 days to fullfil the necessary requirements|
    2021-11-03| B350| Update of information on the portal [chapter 15.35 patent gazette]|
    优先权:
    申请号 | 申请日 | 专利标题
    EP09172345|2009-10-06|
    EP09172345.2|2009-10-06|
    PCT/IB2010/054462|WO2011042851A1|2009-10-06|2010-10-04|Method and system for carrying out photoplethysmography|
    [返回顶部]